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Abstract 

Quantum walks play an important role in the area of quantum algo- 
rithms. Many interesting problems can be reduced to searching marked 
states in a quantum Markov chain. In this context, the notion of quantum 
hitting time is very important, because it quantifies the running time of the 
algorithms. Markov chain-based algorithms are probabilistic, therefore the 
calculation of the success probability is also required in the analysis of the 
computational complexity. Using Szegedy's definition of quantum hitting 
time, which is a natural extension of the definition of the classical hitting 
time, we present analytical expressions for the hitting time and success prob- 
ability of the quantum walk on the complete graph. 

1 Introduction 

The notion of hitting time in classical Markov chains plays an important role 
in Computer Science. The hitting time is used in Monte Carlo algorithms, and 
in randomized algorithms in general, as the running time to find a solution [T]. 
Expressions for the classical hitting time were calculated analytically for many 
graphs \2\. 

It is not straightforward to generalize the classical definition of hitting time 
to the quantum realm. Kempe [3] has provided two definitions and proved that 
a quantum walker hits the opposite corner of a n-hypercube in time 0(n). Krovi 
and Brun [4J have provided a definition of average hitting time that requires 
a partial measurement of the position of the walker at each step. Kempf and 
Portugal [5j have discussed the relation between hitting times and the walker's 
group velocity. 

Inspired on Ambainis' algorithm [6] for solving the element distinctness prob- 
lem, Szegedy [7] was able to abstract out the mathematical structure of that 
algorithm and to provide a definition of quantum hitting time, that is a natural 
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generalization of the classical definition of hitting time. Years of effort show that 
the establishment of that definition is far from trivial. Recently, Magniez et al. [8] 
have extended Szegedy's work to non-symmetric ergodic Markov chains and have 
improved the probability to find a marked state using Tulsi's method [9j. 

In this work we calculate analytically Szegedy's hitting time and the proba- 
bility of finding a set of marked vertices on the complete graph. This calculation 
clarifies many points of Szegedy's definition, such as the analytical behavior of 
the time average of the quantity || C/*|(/)o) — |(/>o) ||, where |(/)o) is the initial condi- 
tion and [/* is the evolution operator after t steps. We show why the calculation 
of the hitting time is easier than the calculation of the success probability. The 
eigenspace associated with the eigenvalue 1 of the evolution operator plays no 
role in the calculation of the hitting time, but must be taken into account in the 
calculation of the success probability. 

The paper is organized as follows. In Sec. [2] we review the basic operators of 
a bipartite graph that are needed in the definition of the evolution operator. In 
Sec. [3] we review Szegedy's definition of the quantum walk's evolution operator 
and the method to obtain part of its spectral decomposition. In Sec. H] we review 
Szegedy's definition of hitting time. In Sec. Owe calculate the hitting time and 
the probability of finding a marked vertex on the complete graph. 

2 Reflection operators in a bipartite graph 

In order to define the quantum hitting time in a graph, Szegedy [7] has proposed 
a quantum walk driven by reflection operators in an associated bipartite graph 
obtained from the original one by a process of duplication, as explained in Sec. HI 
Consider a bipartite graph between the set of vertices X and Y of same 
cardinality. Denote by x and y generic vertices in sets X and Y . The stochastic 
matrices P and Q associated with this graph are defined such that pxy is the 
inverse of the outdegree of the vertex x, if there is a directed edge from x to y, 
otherwise pxy = 0. Analogously, qyx is either the inverse of the outdegree of the 
vertex y or zero. Th.6 Vciriciblcs Pxy 

and Qyx satisfy 

Y,Pxy = l VXGX, (1) 
y& 

Y,%x = ^ G Y. (2) 

x&X 

To define a quantum walk in the bipartite graph, we associate with the graph a 
Hilbert space Ti^ = TC^ W", where n = \X\ = \Y\. The computational basis 
of the first component is {|x) : x G X} and of the second : y G Y^. The 
computational basis of H"'^ is {|x,y) : x G X, y G y}. In the quantum case. 
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instead of using the stochastic matrices P and Q of the classical random walk, 

2 2 

we define the operators A : Ti^ Ti^ and B : Ti^ — > Ti^ as follows 

^ = Y.\(^y)hjl (4) 

where 

A and S are n? x n matrices. Eqs. ([3]) and ^ tell us that the columns of A are 
the vectors \ctx) and the columns of B are Vectors \ax) and obey 

{ax\axi) = 5x,x', (7) 

</3.|/3y) = Ky- (8) 

Therefore 

= /n, (9) 

= In. (10) 

These equations imply that A and i? preserve the norm of vectors, so if is a 
unit vector of "H", then j4|/i) is a unit vector of W"^. The same for B. 

Of course we will investigate the product in the reverse order. Using Eqs. ([3]) 
and dH) we obtain 



AA' = Y,\ax){axl (11) 



x&X 

= T.\Py){^\- (12) 

Using Eqs. ^ and ^ we have (AA^)^ = AA^ and {BB^f = BB^. So let us 
define the projectors 

Ua = AA^, (13) 

Ub = BB'^. (14) 
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Eqs. (fTTj) and (fT2|) show that 11^ project a generic vector of to the subspace 
TIa spanned by { ja^;) : x G X} and to the subspace TIb spanned by {\f3y) ■ 
yeY}. 

We can now define the reflection operators associated with each of these 
projectors 

TZa = 2UA-In2, (15) 

Kb = 2UB-In2. (16) 

2 

TZa reflects a generic vector in around TCa and TZb around TCb- 

Now it is time to establish a connection between the subspaces TCa and TCb- 
The best choice is to analyze the angles between the set of vectors | joa;) : x G X} 
with : y G y}. Let us define the matrix of inner products C such that 

Cxy = {o(x\Py)- Using Eqs. <^ and 1^ we can express the components of C in 
terms of transition probabilities as Cxy = -^VxyQyx^ and in matrix form 

C = A^B. (17) 

C is a square matrix of dimension n. It provides essential information on the 
quantum walk that will be defined on the bipartite graph. C is not a normal 
operator in general. Its singular values and vectors play an important role in the 
dynamics of the quantum walk. 

The theorem of singular value decomposition [TO] states that there are unitary 
matrices U and V such that 

C = UDV\ (18) 

where D is a diagonal matrix of dimension n with nonnegative real components. 
The diagonal elements are called singular values and univocally determined. Ma- 
trices U and V can be determined through the application of the spectral theorem 
to C^C, which is a semidefined positive matrix. 

Let and \^J.j) be the right and left singular vectors respectively and Aj 
the corresponding singular values, then 

C\vj) = Aj|/i,->, (19) 
C^l^j) = Aj \ vj). (20) 



Multiplying Eq. ([19]) by A and Eq. ([20]) by B we obtain 

nAB\vj) = \jA\nj), (21) 
YlBA\^lJ) = \jB\v-). (22) 

The action of operators A and B preserves the norm of vectors, then vectors 
^|/Uj) and B^Vj'^ are unitary. Projectors either decrease the norm of vectors or 
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maintain invariant. Using Eq. (|2ip we conclude that the singular values satisfy 
the inequalities < Xj < 1. So, we can define 9j such that Xj = cosOj, where 
< 9j < tt/2. The geometric interpretation of 6j is the angle between the vectors 
j4||Uj) and -B|z^j), that can be confirmed by using Eqs. p!7|) and (fT9]) . 



3 Evolution Operator and its Spectral Decomposition 

Let us consider a bipartite graph such that X = Y, P = and P = Q. 
Szegedy [7J has defined the one-step evolution operator in the Hilbert space of 
this graph as 

Up -.= 113 11 A, (23) 



where IZa and IZb are given by Eqs. (|T5|) and (|T6j) . 

Eqs. ([2T]) and ([22]) show that the projectors Ha and He have a symmetric 
action over vectors j4|^j^ and B\vj^ for each j. It is expected that the action of 
the reflection operators IZa and IZb on & linear combination of and B^Vj^ 

results in a vector in the plane spanned by and B\vj^. That is, this plane 

is invariant under the action of Up. So let us try the following Ansatz for the 
eigenvectors of Up 

Up{aA\fij) + bB\iyj)) = Xj{aA\nj) + bB\i^j)). (24) 

The goal is to find a, b and that obey Eq. (I24p . Using definition (I23p for Up, 
we eventually obtain that the vectors 

|aj> = '^^^ ^ . — ^ (25) 



\pl sin 0j 



are normalized eigenvectors with eigenvalues e^^*^J when < < 7r/2. We 
have obtained at most 2n eigenvectors of Up so far, because C has dimension 
n. In fact, the exact number depends on the multiplicity of the singular value 1. 
For Qj = 0, ^l^j) and B\vj^ do not span a two dimensional subspace, because 
they are colinear. Let us consider vectors A||Uj). From Eqs. ()2ip and (I22p we 
verify that they are invariant under the action of 11^ and 11^. Then, they are 
invariant under the action of IZa and IZb- Then are eigenvectors of Up 

with eigenvalue 1. If the multiplicity of the singular value 1 is /c, then we have 
obtained 2n — k eigenvectors of Up so far. The remaining n? — 2n-'rk eigenvectors 
cannot be found by using the singular values and vectors of matrix C, on the 
other hand, it is straightforward to show that the missing ones have eigenvalue 
1. 
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4 Quantum Hitting Time 



Szegedy [7J has defined a notion of quantum flitting time tfiat is a naturaf gen- 
erafization of tiie concept of classical flitting time. Let T{X, E) be a connected, 
undirected and non-bipartite graph, where X is the set of vertices and E is the 
set of edges. Define a bipartite graph associated with T{X, E) through a process 
of duplication. X and Y are the sets of vertices of same cardinality of the bipar- 
tite graph. Each edge in E of the original graph T{X,E) is converted 
into two edges in the bipartite graph {xi,yj} and {yi,Xj}. 

The quantum walk on the bipartite graph is defined by the evolution operator 
Up given by Eq. (p3|) . In the bipartite graph, an application of Up corresponds 
to two quantum steps of the walk, from X to y and from Y to X. We have to 
take the partial trace over the space associated with Y to get the state on the 
set X. 

In the classical case, the hitting time H^q xf is the expected number of steps 
in a random walk that starts at xq and ends upon first reaching Xf This 
definition can be generalized to what is called average hitting time. Instead 
of departing from vertex xq, the initial vertex can be sampled according to a 
probability distribution a, such that Ylxex ^i^) ~ Also, instead of reaching 
vertex Xf, one may consider the case of reaching a subset M of X. So, the hitting 
time H^M is the expected number of steps in a random walk that starts at a 
vertex that is sampled according to a probability distribution a and ends upon 
first reaching any vertex of M. Szegedy's definition is the quantum analogue of 
that last version. It is at least quadratically faster than the classical case. 

To define the quantum hitting time, Szegedy has used a modified evolution 
operator Up' associated with a modified directed bipartite graph obtained in the 
following form. Each edge of an undirected graph can be viewed as two opposite 
directed edges, since directed edges are fused to form the non-directed edge. The 
modified directed graph is the bipartite graph obtained by removing all directed 
edges leaving the vertices of the set M, but keeping the directed edges that are 
arriving. This means that if the walker reaches a marked vertex, it will be stuck 
in that vertex in the following steps. To calculate the classical hitting time, the 
original and the modified bipartite graphs are equivalent. However, since the 
stochastic matrix has been modified, in the quantum case the evolution operator 
Up' is different from Up. If the walk starts uniformly distributed, the modulus of 
the amplitude probabilities at the marked vertices will increase at some specific 
moments. The modified stochastic matrix P' is given by 




x^M; 

X e M. 



(26) 
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The initial condition of the quantum walk is 



(27) 



yeY 



Note that |V'(0)) is an eigenvector oi Up with eigenvalue 1, when the probability 
distribution p^y is symmetric. However, |^(0)) is not an eigenvector of Up' in 
general. Before describing the evolution of the quantum walk driven by the 
modified operator Up', let us define the quantum hitting time [7]. 

Definition The quantum hitting time Hp^^j of a quantum walk with evolution 
operator Up given by Eq. (I23p and initial condition |V'(0)) is defined as the least 
number of steps T such that 

F{T)>1-—, (28) 
n 

where m is the number of marked vertices, n is the number of vertices of the 
original graph and F{T) is 



T 

i^(r) = ^5;|b(t)>-|V'(0))|f, (29) 

i=0 



where |V'(0) = f^p'|V'(0)) and Up, is the evolution operator after t steps using 
the modified stochastic matrix. 

Only the singular values of C that are different from 1 are used in the calcu- 
lation of hitting time. To make this point clear, let us write the initial condition 
in the eigenbasis of the evolution operator 

n—k n'^—n+k 
i=l j=n—k+l 



where k is the multiplicity of the singular value 1. The coefficients are given 
by 



c 



,± _ / „ ± 



af\m) (31) 



and obey the constraint 



n—k n^—n+k 
j=l j=n-k+l 
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Applying Up, to |V'(0)) we obtain 



n—k n?—n+k 
j=l j=n— fc+l 



(33) 



When we take the difference |'0(^)) ~ |V'(0))) t^is terms in the eigenspace associ- 
ated with eigenvalue 1 vanish. 

Vectors are self conjugates and |V'(0)) is real, then Eq. ([3T]) implies that 

obtain 



Let us call and c- by c,- . Using Eqs. (|30|) and (j33j) . we 



n—k 



4 E I9r(i-r2t(cos0j)), 



(34) 



where T„ is the n-th Chebyshev polynomial of the first kind |llj. Using Eq. 
we obtain 



F(T) 



„ n—k 
^ \ - I |2 



r + 



2r + 1 - C/2t(cos( 



(35) 



where is the n-th Chebyshev polynomial of the second kind. The quantum 
hitting time is given by 



Hp^M 



m 

1 

n 



(36) 



5 Complete Graph 

Let us label the vertices of the complete graph from 1 to n and suppose that 
the last m vertices are the marked ones. The stochastic matrix of the complete 
graph is 

P=^(n|n">(n"|-I„), (37) 
n — 1 ' ' 

where = l/\/^X]j=i |i) is the normalized uniform vector with n components 
and |j) stands for the j-th vector of the computational basis. 

Let Pa/ be the matrix obtained from P by removing the lines and columns 
corresponding to the marked elements, then 

Pm = ^((n-m)|t."-'")(u"— I -^_™). (38) 



The characteristic polynomial of Pm is 



The eigenvector with eigenvalue (n — m — l)/{n — 1) is 



:= (40) 
and the eigenvectors with eigenvalue — l/(n — 1) are 

^ (41) 



VJTT 



for l<j<n — m — 1. That set of eigenvectors forms an orthonormal basis. 
The modified stochastic matrix is 



I T^, 1 < X < m — n: , 

P-y = \ X " / ^ (^2) 

I Oxy, m — n < X < n. 



All operators of Sec. [2] must be calculated using the modified matrix. To find 
the spectral decomposition of C/p/, the key operator is C given by Eq. (fT7|) . The 
components of Cxy are ^PxyQyx- We have to replace pxy and qxy by p'^y. Using 
Eq. ([42|) we obtain 

\Pm 
Im 



C 



(43) 



C is hermitian, then the nontrivial singular values Xj are obtained by taking the 
modulus of the eigenvalues of Pm- The right singular vectors jz^j) are the eigen- 
vectors of P]\j- If the eigenvalue of Pm is negative, the left singular vector is the 
negative of the eigenvector of Pm ■ These vectors must be increased with m zeros 
to have the correct dimension, compatible with the dimension of C. Summariz- 
ing, and — 1 <J < n — m — 1 are the right and left singular vectors, 
respectively, with singular value cos^i = \iyn-m) is both the right and left 
singular vectors with singular value cos02 = ■ Finally, the submatrix 1^ 

in Eq. (j43p adds to the list the singular value 1 with multiplicity m with the 
associated singular vectors where n — m+l<j<n. 

The eigenvectors and eigenvalues of Up/, that can be obtained from the sin- 
gular values and vectors of C are given in Table [H It is missing — 2n + m 
eigenvectors, all of them associated with eigenvalue 1. 

5.1 Hitting Time on the Complete Graph 

The initial condition in the complete graph reduces to 

1 " 

\m) = r-< — TT E (1 - ^^y)V)\y)- (44) 



x,y=\ 
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Eigenvalue 


Eig 


•envector 


Interval 




H) = - 


sin 6*1 


l<j<n — m— 1 










) = - 


V2sin02 


j = n — m 


1 




> = m 


n — m+l<j<n 



Table 1: Eigenvalues and normalized eigenvectors of Up' obtained from the singular 
values and vectors of C. The vectors |f„-m) and are given by Eqs. (|40| and ((4T|) 
respectively. 



Using the eigenvectors of Tabled! the expression for IV'(O)) and the definition 
(|3T]). we obtain 
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0, l<j<n — m — 1; 

^/^r^(l_eT«2) ._ (45) 



where 62 is given by 

^ n — m — 1 , , , 

cos 6*2 = . (46) 

n — 1 

The uniform singular vector given by Eq. ()40p is the only one used in the calcu- 
lation of the hitting time. 

The quantity F{T) defined in Eq. ([29]) reduces to 

2 (n - 1) (n - m) (2 T + 1 - U2T f 
n[2n — m — 2) (1 +1) 

The graph in Fig. [T]shows the behavior of the function F(T). F{T) grows rapidly 
through the dashed line 1 — — , then oscillates around the limiting value given by 

%-nlt-2^ (dotted line). 

For n ^ m, the hitting time Hp^m is obtained by employing the method of 
series inversion on the equation F{T) = 1 — — . The first terms are 
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Figure 1: Graphs of the function F{T) (solid Hne), 1 — ^ (dashed hue) and !^2n-m-^) 
(dotted hne) for n = 100 and to = 21. The hitting time can be seen in the graph at time 
T such that F{T) — 1 — which is about 1.13 in this case. 



where jo is the first spherical Bessel function or the unnormalized sine func- 
tion [n]. The value of (^) is around 1.9. 

5.2 Probability of Finding a Marked Vertex 

The hitting time is used in search algorithms as the running time. It is important 
to calculate the probability of success at the stopping time. The calculation of the 
probability of finding a marked element is more elaborated than the calculation 
of the hitting time, because we have to find \il^{t)'^ explicitly, and therefore the 
eigenvectors with eigenvalue 1 must be considered. 

For the complete graph, the eigenvectors that are not orthogonal to the initial 
condition are |a^_^) and some of the eigenvectors associated with the eigenvalue 
1. Using Eqs. (I3|) to ([6]) and (j42]) we can obtain |a^__^). Substituting |a^_^) 
and c^, given by Eq. (fl5|) . into Eq. ([33]) . we obtain 




n^— n+fc 
j=n~k+l 
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The component associated with the eigenvalue 1 can be determined by trial and 
error directly from the structure of matrix Up/. The result is 



n —n+k 



1 



-m 



j=n—k+l 



y/n{n - 1) 

n — m — 1 
2n — m — 2 



2n — m — 2 



Yl (i-'5-s/)N>|y>+ 



x,y=l 



n—m n 



E E i\^)\y) + \y)\^)) + 



x=l y=n—m+l 



5^ (1 - 6,y)\x)\y) ] . 

x,y=n—m+l 



(50) 



The probability of finding a marked element is calculated by using the pro- 
jector Vm in the vector space spanned by the marked elements, that is 



Vm 



(51) 



x=n—m+l 

The probability is given by (V'(*)|'PAf |V'(*))- Using Eq. ([I9|) and ([50]) . we obtain 



PM{t) 



m(m — 1) m{n — ni) 
n(n — 1) n(n — 1) \2n — m — 2 

/n — m — l\ n — m — 1 ^ 
U2t~i ( — ] + 



n — 1 „ /n — m — 1" 



n — 1 I 2n — m — 2 ^ 
The graph of PA.i{t) is depicted in Fig. [2] when n = 100 and m = 21. 



(52) 




Figure 2: Graph of the probability of finding a marked vertex as function of time for 
n = 100 and m = 21 . The value at f = is — and the function has period 
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The first point of maximum occurs at time 



arctan 



( 



^Jln — m, — 2 



) 



(53) 



max — 



n — m — 1 



) 



2 arccos 



n — 1 



the asymptotic expansion of which is 



t- 



■max — 




) 



(54) 



for m. Substituting that result into the expression of probability, we obtain 



For any values of n and m, the probability of finding a marked vertex is greater 
than ^, if the measurement is carried out at time tmax- The instant tmax is smaller 

than the hitting time given by Eq. (fl8l) . since f« 0.56 while ~ 0.67. 

The value of the success probability of an algorithm that uses the hitting time as 
the running time will be less than th.6 proba>bility cit time tmax* 

Evaluating pM 

at time Hp^M and taking the asymptotic expansion, we obtain 



The first term is around 0.45 and is independent of n or m. This shows that the 
hitting time is a good parameter for the stopping point of searching algorithms 
on the complete graph. 
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